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Comparative Effectiveness and the 
Future of Clinical Research in Diabetes 



Comparative effectiveness research 
(CER) has a number of features that 
distinguish it from clinical research 
in general (1,2). CER is, in essence, framed 
by asking the core question: for a doctor 
and a patient, what is the best treatment 
for that patient in terms of both benefits 
and harms? To answer that question, the 
process essentially would require effective 
translation of the following issues: J) 
head-to-head comparisons of the pro- 
posed interventions versus the best avail- 
able alternatives; 2) emphasis on both 
benefits and harms, the harms often hav- 
ing the most immediate impact on the 
patients; 3) the examinations of effective- 
ness in key subgroups within a disease, 
so that a given patient and doctor can 
easily match the patient with that group; 4) 
the study of multiple relevant outcomes, 
each having adequate power to detect 
differences; and 5) the impact of the 
provider, and the differential quality 
rendered, especially in large multicenter 
trials. Highlighting these features has 
given rise to the notion that, in addition 
to classic randomized controlled trials 
(RCTs), "pragmatic" trials must be con- 
ducted. Further, observational studies 
carried out through registries or other da- 
tabases need to be used to detect uncom- 
mon but important harms, to provide 
data on subgroups not included in trials 
or included in small numbers, and to 
evaluate the effectiveness of care in com- 
munity settings. In short, the overarch- 
ing goal of a comparative effectiveness 
exercise is to ask a very simple question, 
"Does an intervention work, and if so, 
for whom and in what setting?" 

In this issue of Diabetes Care, the 
rationale and design of the Glycemia Re- 
duction Approaches in Diabetes: A Com- 
parative Effectiveness Study (GRADE) is 
published (3). As outlined by the study 
investigators, GRADE "is a pragmatic clin- 
ical trial that will make head-to-head 
comparisons of major drug classes cur- 
rently used to treat [type 2 diabetes], 
with the overarching goal of providing 
better guidance to practitioners in the 
choice of medications." As such, by de- 
sign, this study will compare the currently 
available products for treatment of type 



2 diabetes, i.e., sulfonylurea, dipeptidyl 
peptidase 4 inhibitor, glucagon-like pep- 
tide 1 receptor agonists, and basal insulin 
in recently diagnosed, metformin-treated 
patients. It may be because of timing 
or the availability or other issues, but at 
this time it doesn't appear that a sodium- 
glucose cotransporter-2 inhibitor will 
be part of the study. GRADE will exam- 
ine the effectiveness of the drugs in 
maintaining goal glycemia (A1C <7%, 
<53 mmol/mol) over time. Other out- 
comes reported will include relative 
effects on selected microvascular com- 
plications and cardiovascular risk fac- 
tors; patient-centered outcomes such as 
adverse effects, acceptability, and tolera- 
bility; and cost-effectiveness. 

Given this background, does the 
GRADE trial match up to the criteria for 
optimal CER research? Well, the answer 
is both a "Yes," and a "No!" A resounding 
"Yes" with respect to one of the major 
issues, head-to-head comparisons: It is 
very difficult for the industry to perform 
such head-to-head trials for obvious rea- 
sons, and with this proposal, the GRADE 
investigators have taken a further step, 
bravely, with a four-arm comparison. 
Thus, just based on this parameter, the 
study is novel and important. The results 
will clearly add new knowledge on how 
best to treat these patients. 

On the other hand, GRADE may not 
be considered a pure CER study. Specif- 
ically, one can argue that it does not ad- 
dress, or perhaps does address well 
enough, the other critical issues. Based 
on the current design, statements will not 
be able to be made, without blocking or 
stratifying, about patients in key sub- 
groups as defined by past evidence by 
the investigators themselves and by the 
American Diabetes Association Clinical 
Practice Recommendations (4). For ex- 
ample, some of these subgroups will in- 
clude 1) patients with high versus at- or 
below-target A1C; 2) low socioeconomic 
status patients and older patients with 
multiple chronic conditions (particularly 
cardiovascular disease) (5,6); and 3) 
those patients with multiple medica- 
tions (i.e. polypharmacy) (7), because it 
would appear that the sample size may be 



too small for these more complex patients. 
In addition, without special attention, pa- 
tients with high BMI, patients with depres- 
sion, patients whose adherence is less than 
optimal (8), and other subgroups defined 
by the variables mentioned by the investi- 
gators, will be analyzed only in the post 
hoc analyses. One very important concept 
would be the concern that this trial, based 
on these limitations, could suffer the fate 
of Look AHEAD (Action for Health in Di- 
abetes), ACCORD (Action to Control 
Cardiovascular Risk in Diabetes), and 
ADVANCE (Action in Diabetes and Vas- 
cular Disease: Preterax and Diamicron 
Modified Release [MR] Controlled 
Evaluation) — all disappointing in not 
decreasing the occurrence of cardiovas- 
cular events, as pointed out in a recent 
editorial (9). The evaluation for sub- 
group effects, or heterogeneity of treat- 
ment effects, is a critical issue in CER 
(1,8,10-12). 

Both macro- and microvascular out- 
comes are to be collected. It will be im- 
portant to ensure that there is adequate 
power to show differences. Adequate 
power will be needed even with micro- 
albuminuria because blood pressure 
treatment may modify its development. 
Thus, the investigators will need to ensure 
that these outcomes will provide mean- 
ingful information given the number 
of subjects evaluated for a relatively short 
timeframe in patients within 5 years of 
diagnosis. Thus, one would wonder, based 
on the design, as to whether these long- 
term outcomes may be problematic. 

GRADE might be more appropriately 
labeled an "efficacy" rather than an "effec- 
tiveness" trial. It would appear that the 
patients are highly selected for adherence. 
Further, many of the study sites appear to 
be led by well-established clinician re- 
searchers in the field of diabetology and 
endocrinology. Since the target patient 
cohort appears to be more appropriate 
for primary care practice than a subspe- 
cialty population, it will be critical for 
these specialists to work closely with the 
primary care doctors in their geographical 
areas. 

There is also the issue of patient 
centeredness, a major feature of the 
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Patient-Centered Outcomes Research In- 
stitute (PCORI) strategies. A tight efficacy 
trial, focusing intensely on both glycemic 
control and on side effects, and which 
could be the basis for larger studies, 
possibly observational, in real life set- 
tings, is badly needed. To explicate the 
harms, more attention would have to be 
paid to generic quality of life measures, 
diabetes-specific quality of life measures, 
the measurement of mild as well as more 
serious episodes of hypoglycemia, the 
measurement of nonadherence due to 
drug side effects or depression, and 
satisfaction with treatment. These is- 
sues are mentioned in the article, but 
appear to be secondary, not equal 
coprimary sets of outcomes. Thus, an 
issue the investigators need to consider 
is the possibility that these factors may 
not be assessed by frequent enough 
administration of the questionnaires. 

In summary, GRADE represents the 
largest study to date funded by the Na- 
tional Institutes of Health in evaluating 
management of type 2 diabetes. In this 
regard, this study is a huge undertaking 
and is an important next step. Even 
though GRADE would not be seen as 
fulfilling many criteria for CER, it can 
provide, especially with intense attention 
to adverse effects, the kind of short-term 
comparative information that providers 
who care for patients with diabetes so 
badly need. 
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